SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge
نویسندگان
چکیده
We present the results of the Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge, aiming to bring together researchers in educational NLP technology and textual entailment. The task of giving feedback on student answers requires semantic inference and therefore is related to recognizing textual entailment. Thus, we offered to the community a 5-way student response labeling task, as well as 3-way and 2way RTE-style tasks on educational data. In addition, a partial entailment task was piloted. We present and compare results from 9 participating teams, and discuss future directions.
منابع مشابه
Celi: EDITS and Generic Text Pair Classification
This paper presents CELI’s participation in the SemEval The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge (Task7) and Cross-lingual Textual Entailment for Content Synchronization task (Task 8).
متن کاملLIMSIILES: Basic English Substitution for Student Answer Assessment at SemEval 2013
In this paper, we describe a method for assessing student answers, modeled as a paraphrase identification problem, based on substitution by Basic English variants. Basic English paraphrases are acquired from the Simple English Wiktionary. Substitutions are applied both on reference answers and student answers in order to reduce the diversity of their vocabulary and map them to a common vocabula...
متن کاملETS: Domain Adaptation and Stacking for Short Answer Scoring
Automatic scoring of short text responses to educational assessment items is a challenging task, particularly because large amounts of labeled data (i.e., human-scored responses) may or may not be available due to the variety of possible questions and topics. As such, it seems desirable to integrate various approaches, making use of model answers from experts (e.g., to give higher scores to res...
متن کاملThe joint student response analysis and recognizing textual entailment challenge: making sense of student responses in educational applications
We present the results of the Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge. The goal of this challenge was to bring together researchers from the Educational Natural Language Processing and Computational Semantics communities. The goal of the Student Response Analysis (SRA) task is to assess student responses to questions in the science domain, focusing on co...
متن کاملUKP-BIU: Similarity and Entailment Metrics for Student Response Analysis
Our system combines text similarity measures with a textual entailment system. In the main task, we focused on the influence of lexicalized versus unlexicalized features, and how they affect performance on unseen questions and domains. We also participated in the pilot partial entailment task, where our system significantly outperforms a strong baseline.
متن کامل